A year ago, not many people knew about Google. But it was the search engine both by and for the Linux community. Now everybody knows about Google, which powers Yahoo's Web searches as well as its own.
While Google remains a great search engine, the company's decision to patent its search methods hasn't sat well with those in the Linux community who don't cotton to software patents (such as our own Technical Editor, Don Marti).
There are also other search engines with strong Linux and UNIX credentials. One is Fast Search and Transfer ASA (FAST) <www.alltheweb.com>, a Norwegian company with offices in the U.S. and a partnership with Dell. intended to build the world's largest and deepest search engine.
Early last year Lycos made a substantial investment in FAST, and now co-brands FAST's four basic search engines: FAST Web Search, FAST FTP Search, FAST MP3 Search and FAST MultiMedia Search (all of which can be found at alltheweb.com and lycos.com -- they use the same engines).
FAST's engines run on FreeBSD and are reportedly developed on a mix of FreeBSD and Linux machines. In fact, FAST's first engine, FTPsearch, was developed under the Free Software Foundation's GPL. You can still download the GPL version of that software at <ftp://ftpsearch.ntnu.no/pub/ftpsearch/>. Search results are presented by Apache and PHP.
We also understand that some of FAST's people have been involved in PHP's development for a long time, and that many of FAST's R&D people in Norway come from one UNIX-oriented computer club at the university in Trodheim. It's called "Programvareverkstedet," or PVV <http://www.pvv.org>.
The products FAST sells are closed source, which is also the case for every other search engine at this point (or at least that we know of -- correct us if we're wrong).
For more about FAST's technologies, click the "Technology" tab on the company's home page.
Sidebar
In another significant search engine development, Yahoo began in November to charge businesses to hurry their listings into Yahoo's "Business to Business" and "Shopping and Services" areas within the "Business and Economy" category. For $199, Yahoo's Business Express program fast-tracks submissions for review and possible inclusion in Yahoo's listings in either of those two areas. According to the FAQ <http://docs.yahoo.com/info/suggest/faq.html>, "...any site submitted to these areas will be reviewed and either added or denied within seven business days. If your site is denied, you will be told why and will have a chance to appeal the decision. "
Meanwhile, the Open Directory Project <www.dmoz.org> continues to grow at an explosive rate. A cursory set of searches shows the two services are highly competitive. The question now is, how do they scale?
There's not much you can do to help Yahoo other than join the company or pay for a listing. But there's a ot you can do to help the Open Directory Project — mainly as an editor. Just navigate down to a topic that obsesses you and sign up to become an editor through the link on that page.
— Doc Searls